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1. Introduction 

We consider a continuous time Markov chain (£t)t>o on a countable (finite or 
infinite) state space V. Following [5] the dynamics is defined knowing the jump rates 
r(x, y), x ^ y in V, under the assumption that r(x) := J2 V £V r ( x > v) < +°° f° r a ^ 
x G V. Then, at each site x the system waits an exponential time of parameter 
r(x) afterwards it jumps to a state y with probability r{x 1 y)/r{x). We assume that 
a.s. for any fixed initial state explosion does not occur, hence the Markov chain is 
defined in V for all times t S K+ and we do not need to introduce any coffin state. 
We denote by P x the law on the Skohorod space Z)(R+; V) of the Markov chain 
starting at x. 

In what follows we restrict to irreducible Markov chains such that there exists a 
unique invariant probability measure, which we denote by n. As in [SJ, by invariant 
probability measure tt we mean a probability measure on V such that 

^2 ir(x)r(x,y) = ^ w(y)r(y,x) VxEV (1.1) 

yeV y£V 

where we understand r(x, x) = 0. We stress that the existence of tt is guaranteed 
if V is finite, while in general uniqueness is automatic if tt exists. 

A fundamental result in the theory of large deviations is given by the Donsker- 
Varadhan Large Deviations Principle (LDP) of the empirical measure of Markov 
processes. We recall its statement referring to the above Markov chain £. Denote 
by V{V) the space of probability measures on V endowed of the weak topology. 
Given T > the empirical measure /jlt- 25(ffi+; V) — > V(V) is defined by 

l*r{X) = ^J dtS Xt (1.2) 

where S y denotes the pointmass at y. Given x S V, the ergodic theorem [8] implies 
that the empirical measure [Lt converges ¥ x a.s. to tt as T — > oo. In particular, 
the family of probabilities {F x o yU^ 1 }T>o on ~P(V) converges to S n . In [S] the 
large deviations from the above limit theorem have been studied by Donsker and 
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Varadhan. Under suitable hypotheses (see Remark ll.3l below) they proved that as 
T — > +00 the family of probability measures {P^ o h^ 1 }t>o on ^00 satisfies a 
LDP with good rate function I such that 

1(h) = sup {- {fx, h^Lh)} (1.3) 

h 

as h varies among the strictly positive functions in the domain of the infinitesimal 
generator L (in general, < fJ,, f >■= T,xev V( x ) f ( x )) ■ 

The above result has been derived in [5]-(I) from an analogous result for discrete 
time Markov chains by an approximation argument in the case of V finite. The 
extension to V infinite has been achieved in [5]— (III) , while in [5]-(IV) the LDP for 
the empirical measure is obtained by contraction from the LDP for the empirical 
process. 

Our aim in this note is to give an alternative proof of the LDP for the em- 
pirical measure by contraction from the joint LDP for the empirical measure and 
flow recently proved in [2]. The result is interesting since we obtain two different 
representations of the rate functional for the empirical measure, one in terms of a 
supremum and the other one in terms of an infimum. As can been seen for example 
in the proof of Proposition 11.71 this fact is very useful. Moreover the proof of our 
result is interesting by herself since it exploits several discrete geometric feature of 
the underlying graph. We show also that in the finite dimensional case the coinci- 
dence of the supremum with the infimum is an instance of the Fenchcl-Rockafcllar 
duality. 

We recall the joint LDP for the empirical measure and flu in [5] and fix some 
notation. We denote by E the set of ordered edges in V with positive transition 
rate, namely E := {(y, z) G V x V : y 7^ z and r(y, z) > 0}. Then for each T > 
we define the empirical flow as the map Qt '■ D(K. + ; V) — > [0, +00]^ given by 

Q T (y,z)(X):=± ]T S y (X t -)S z (X t ) (y,z)eE. (1.4) 

0<t<T 

Namely, TQx(y, z) is P^ a.s. the number of jumps from y to z in the time interval 
[0, T] of the Markov chain £ starting at x. As discussed in [2], Qt(v,z) converges 
to Tr(y)r(y, z) at T — > 00 ¥ x a.s. 

Elements in [0, +00]^ are called flows. We denote by L+(E) the subset of sum- 
mable flows, i.e. of flows Q such that ||Q||i := E^zjGB^fei 2 ) < +°°- Given a 
summable flow Q e L\ (E) its divergence div Q : V — > R is defined as 

divQ(y)= Q(y> z )- E V^ V - ( L5 ) 

z:(y,z)£E z:(z,y)eE 

Observe that the divergence maps L+(E) into L 1 (F). 

To each probability fj, <G V(V) we associate the flow G M.f_ defined by 

Q»(y,z):=ii{y)r(y,z) (y,z)eE. (1.6) 

Note that G L+(E) if and only if (fi, r) < +00. Moreover, in this case, by 

has vanishing divergence if only if /1 is invariant for the Markov chain £, i.e. 

/I = 7T. 

We endow L\ (E) of the bounded weak* topology. As discussed in [2] this topol- 
ogy is the most suited for studying large deviations of the empirical flow. For 
completeness we recall its definition although it will never be used below (see [7] 
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for a detailed treatment). A subset W C L\.{E) is open if and only if for each I > 
the set {Q G W : \\Q\\i < £} is open in the ball {Q G L\(E) : \\Q\\x < 1} endowed 
of the weak* topology inherited from L x (i?). When E is finite, the bounded weak* 
topology coincides with the L 1 -topology. 

We can now recall the LDP proved in [2]. We start from the assumptions. To 
this aim, given / : V — > M such that J2 y ev r ( x > v) 1/(2/) I < +°° f° r each x G V, we 
denote by L/ : V — >• R the function defined by 

L/(z):=5>(*,») [/(*)-/(*)], (1-7) 
yev 

Definition 1.1. Given a G K+ we say i/iat Condition C(o~) holds if there exists a 
sequence of functions u n : V — > (0, +oo) satisfying the following requirements: 

(i) For each x G V and n G N it holds ^2 ye y r(x 7 y)u n (y) < +oo. 

(ii) The sequence u n is uniformly bounded from below. Namely, there exists 
c > such that u n (x) > c for any x £ V and n G N. 

(iii) T/ie sequence u n is uniformly bounded from above on compacts. Namely, 
for each x G V there exists a constant C x such that for any n G N it holds 
u n (x) < C x . 

(iv) Set v n := —Lu n /u n . The sequence v n : V — > R converges pointwise to some 
v. 7->R. 

(v) The function v has compact level sets. Namely, for each <el the level set 
{x G V : v(x) < £} is finite. 

(vi) There exists a positive constant C such that v > a r — C '. 

Let $:l|XR + -> [0, +oo] be the function defined by 

q 

q log — (q-p) if q,p G (0,+oo) 

: = \ p if q = 0, p G [0, +oo) ( L8 ) 

~oo if p = and o G (0, +oo). 

For p > 0, $(•, p) is a nonnegative convex function and is zero only at q = p. Indeed, 
it is the rate function for the LDP of the sequence Nt/T as T — > +oo, (Nt)tes. + 
being a Poisson process with parameter p. 

Finally, we let /: V{V) x L\(E) — > [0, +oo] be the functional defined by 



HQ(y,z),Q"(y,z)) if div Q = 0, <ji,r) < +co 
(v,z)ce (1.9) 
+oo otherwise. 



Remark 1.2. As proved in ^[Appendix B] the above condition (fJ>,r) < +oo can 
be removed, since the series in (|1.9|) diverges if (/i,r) = +oo. 

Remark 1.3. Condition C(0) (i.e. C(a) with a = 0) with (i) replaced by the fact 
that u n belongs to the domain of the infinitesimal generator, and with Lu n defined 
as the infinitesimal generator applied to u n , is the condition under which the large 
deviation of the empirical measure is derived in \S\-(IV). 

Theorem 1.4 (Bertini, Faggionato, Gabrielli, [5]). 

Assume Condition C(tr) to hold with a > 0. (Alternatively, assume the hyper- 
contractivity Condition 2.3 in ^\). Then as T — > +oo the family of probability 
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measures {¥ x o (/j,t,Qt) 1 } on V(V) x L\{E) satisfies a LDP with good and con- 
vex rate function I . Namely, for each closed set C C V(V) x L+(E), and each open 
set A C V(V) x L\(E), it holds for each x G V 

BE - log P, ((p T , Q T ) EC) < - inf 7(/i,Q), (1.10) 

lim IlogPj^T^T) G^l) > - inf I(n,Q). (1.11) 

Remark 1.5. Condition C(a) with a > for alternatively the hypercontractivity 
Condition 2.3 in implies that (7r,r) < +oo (see Lemma 3.9 in ^\). 

We can finally state our new results. 

Theorem 1.6. Assume that Condition C(o~) holds with a > (alternatively, as- 
sume the hypercontractivity Condition 2.3 in ^\). Then as T —> +oo the family of 
probability measures {¥ x o [ij, } on V(V) satisfies a LDP with good rate function I 
such that 

Xji) = inf {I(ji, Q) : Q G L\(E)} . (1.12) 

I((u) < +oo if and only if (fj,, r) < +oo, in this case the above infimum is indeed at- 
tained at a unique flow Q* G L^(E). Moreover the following alternative variational 
characterization holds 

= | SUp { _ {^^ § Le 9 ) : g G L°°(V)} if (/i,r) < +co , 

1 +oo otherwise . 

Since the projection map P(V) x L+(E) 9 (/i, Q) — ► /i G 'P(V^) is trivially con- 
tinuous, due to the contraction principle the first part of the theorem up to (|1.12[) 
follows from Theorem 11.41 Since I(fi,Q) = +oo if r) = +oo and 0) < +oo 
if {/i, r) < +oo, we get that X(/x) is finite if and only if (fj,, r) is finite. Finally, note 
that since /(•,•) is good, then the map L\{E) 3 Q —> I(fj,,Q) is lower semicon- 
tinuous with compact level sets and therefore it has a minimum. The uniqueness 
of the minimizer follows from the fact that L(fi, •) is strictly convex on the set 
{Q : I (/j,, Q) < +oo}, as can be easily derived from the strictly convexity of $(-,p) 
for p > 0. The non trivial task is therefore to prove (|1.13|) . 

We will use the following characterization of / proved in [2] (see formula (5.4) 
there) 

I(fj,,Q) = sup I^ F {n,Q). (1.14) 

In f| 1 . 14[) the supreprum is among all pair <fi, F with <fr £ L°°(V), F G L°°(E), being 
respectively L°°{V) the set of bounded functions on vertices and L°°(E) the set of 
bounded functions on edges. Moreover we have 

U,f{ii,Q) ~ (0,divQ) - {fi,r F - r) + £ Q(y,z)F(y,z) (1.15) 

where r F : V — > (0, +oo) is defined by r F (y) = YlzeV r(y, z)e F ^ y ' z ' > and (</>, div Q) = 
J2 y ev ^(f) divQ(y). In formula (|1.14p is proved with a slightly different class 
of functions but the argument can be clearly adapted to the present setting. Sec 
also Section 0] for computations similar to (|1.14[) . 

In the reversible case we have the following additional result: 
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Proposition 1.7. Assume the same setting of Theorem \1.6l Suppose that the 
invariant measure n is also reversible, i.e. 7r(y)r(y, z) = 7r(z)r(z, y) for all y, z G V . 
Suppose that \i G ViV) is such thatX^\i) < +00 (i.e. (fJ,,r) < +00). Then 

Q*{y,z) = Q*(z,y) = V ' V{y)v(z)r(y,z)r(z,y) 
is the minimizing flow in (|1.12j) and it holds 

y€V zt£V 

Moreover (|1.13|) admits a maximizing sequence that is a suitable approximating 
sequence in L°°(V) of the extended function g : V — > {—00} U M. defined by 

g(y) ■= iogV^(y)/ 7r (y) ■ ( L1 6) 

The rest of the paper is devoted to the proof of Theorem II .61 (see Section [2]) and 
the proof of Proposition [TTT] (see Section [3]). Most of the technical difficulties come 
from the case of V infinite. In Section |4] we give for V finite an alternative proof 
of Theorem 11.61 showing that it is indeed a special case of the Fenchel-Rockafellar 
Theorem. In the case |V| < +00 different proofs where given in [5] and pQ. 

2. Proof of Theorem 11.61 

2.1. Some preliminary results on oriented graphs. Let (V,£ ) be an oriented 
graph. Given y,z G V, an oriented path from y to z in (V,£) is a finite string 
(xx, X2, ■ • ■ , x n ) with x\ = y, x n = z and (xi, ajj+i) G £ for all i = 1, . . . ,n — 1. 
A cycle in (V,£) is an oriented path (xx, X2, ■ ■ ■ , x n ) with x\ = x n . It is called 
self-avoiding if Xj 7^ Xj for 1 < i < j < n. Given a cycle C we denote by I<7 the 
function on £ taking value 1 on the edges (xi, 1 < i < n, and zero otherwise. 

Let us now refer to the oriented graph (V, E). We denote by C the family of self- 
avoiding cycles in (V,E). Given C G C, note that 1c is a divergence-free flow in 
L+(E). In [2] [Lemma 4.1] it is proved that any divergence-free flow Q G L+(E) can 
be written as Q = X^cec QiP)^-C f° r suitable nonnegative constants Q(C), C G C. 
The above decomposition has to be thought as Q(y,z) — J2cec Q(C)^c{y, z ) f° r 
each edge (y, z) G E. 

Take [i G V(V) such that (/i, r) < +00. Consider the oriented graph (V^,£^) 
where 

E^ = {(y, z) : Q"(y, z) = A*(y)r(y, «) > 0} , 

= {ty G V : 3z G V with (y, z) G E^ or (z, y) G E^} . 

Trivially, the support of /z is included in Vj,. If z G \ supp(/i) then there exists 
y G supp(/x) with r(j/, z) > 0. 

On the set we define the equivalence relation y ~ z as follows: y ~ z if and 
only if in (V^,£^) there exists an oriented path from y to z as well as an oriented 

path from z to y. We call (V^)tec the equivalence classes of V M under the relation 
~, and set 

Eft :={(y,z)eE, : y,z€Vft}. 

Above C is the index set of the equivalence classes, given by C = N = {1, 2, . . . } if 
there are infinite classes, or£ = {l,2,...,|£|}if there is a finite number of classes. 
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Given Q £ L\(E) and given y ^ z in V we set Q(y, z) = if (y, z) $ E. The 
support of Q, denoted by E(Q), is defined as E(Q) = {(y, z) £ E : z) > 0}. 

Lemma 2.1. Let Q £ LW.E) satisfy I(ii,Q) < +oo. Then Q(y, z) — if y ^ z in 
(V^Ef,). In particular, E(Q) C UtzcE^ . 

Proof. Suppose that Q(y, z) > 0. Since Q) < +oo the flow Q must be 
divergence-free. In addition, since 3>(q,p) = +oo if q > and p = 0, the flow 
Q must have support contained in E^. By the cyclic decomposition, we can write 
Q = J2cecQ(C)^C- In particular, (y, z) £ Co for some Co £ C with Q(Cq) > 0. 
Since Q has support contained in E^ it must be (it, v) £ E^ for all (u, v) £ Co- The 
cycle Co can be divided in two oriented paths, one from y to z and one from z to y 
in (V^, -E^,). This implies that y, z belong to the same equivalence class . Since 
E{Q) C Efj, it must be (y, z) £ E^ and therefore (y, z) £ E^ \ □ 

2.2. Proof of Theorem [[M We define the functions h, Ji : P(V) -)• [0, +oo] as 
the r.h.s. of (II. 121) and (|1.13[) . respectively: 

h(fx):=M{l(Li,Q) : Q £ L\(E)} , (2.1) 

and 

[ sup{ -<^e-W) : .geL-OO}, if( M ,r}<+oo 
^ ' ' 1 +oo otherwise. ' 

As already explained we only need to prove the equality I\ (/i) = J\ (jx). By Remark 
11.21 we can restrict to probability measures [i such that (fx, r) < +oo. 

Wc first show the inequality Ii(fx) > Ji(^). Given g : V — >• K, we define the 
gradient Vg : E — > M as Wg(y, z) := g{z) — <?(?/)■ We now observe that for any 
,g G L°°(V) and for any divergence-free flow Q £ L\(E) the following integration 
by parts formula is satisfied: 

(Q,V ff ) = ]T Q(y,z)(g(z)-g(y)) 

(y.z)eE 

= E E = -(divQ, 5 ) = o. 

ySV z:(z,y)eE z:(y,z)£E 

(2.3) 

After these observations the conclusion is simple. We can restrict the infimum 
in (|2.ip to divergence-free Q' s - Fix 4>,g £ L°°{V). We can use the variational 
characterization (|1.14[) of the rate function / and deduce 

1^,0) > I<t»Vg{^ Q) 

= E {-Kv)r{y,z)[e 9{z) ~ 9 ^ -i\+Q(y,z)[g(z)-g(y)}} 

= -(Li,e~ 9 Le 9 ). (2.4) 

In both the above identities we used that Q is divergence-free. Minimizing over Q 
and maximizing over g in (|2.4p we obtain that ii(/x) > Ji(ix). 

We show now the converse inequality ii(/i) < Ji(fx). As already observed after 
Theorem 11.61 the infimum defining I\ in (|2.1[) is attained as some flow Q*, i.e. 
Q*) = h(p). Taking Q = in we get 

h(fj,)=I(fi,Q*) < 7(/i,0) = ( M ,r) < +oo. (2.5) 
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Due to Lemma Ej] we can write 



/(m,Q*) = E E $(Q*(y,z),rty)r(y,z)) + E t*(v>(v,z). 

(2.6) 

The next step is to show that Q*(y,z) > for any (y, z) e Suppose by 

contradiction that there exists an edge (y, z) £ E^ such that Q*{y, z) = 0. Take a 
cycle C contained in (V^f , £^) and containing the edge (y, z) (it exists by definition of 
the equivalence relation ~). For any a > consider the perturbed flow Q* a := Q* + 
al c . Then /(//, Q* a ) < +oo. Moreover, the map I + 9a-> I([i,Q* a ) 6 [0, +oo) is 
continuous and C 1 on (0, +oo). Its derivative on (0, +oo) is given by 

d [ t( r>*<\ V i Q*{v,w)+a 

H^QJ = V log / w — r- ( 2 - 7 ) 

J u[v)r(v,w) 



da 



The above derivative becomes strictly negative for a small enough and this contra- 
dicts the fact that Q* is a global minimizer. 

Consider now an arbitrary cycle C contained in (V^ ,Ejp). We have just proved 
that Q* is strictly positive on the edges of C. Hence, now we can conclude that the 
above function R + 3a-> Q* ) e [0, +oo) is C 1 on all K + (zero included) where 
its derivative is given by (|2.T[t . Since Q* is a global minimizer the value a = is 
a local minimum and consequently the value of the derivative in correspondence of 
a = must be zero. From (|2.7[) we get 

The validity of (|2.8[) for any cycle C contained in (Vp, E^p) implies that there 
exists a function gi : V^t E such that 

log ®\ iy ; Z \ = 9i{z) - 9M , V(y, z) 6 E$> . (2.9) 

The function is determined up to an arbitrary additive constant in the following 
way. Let y* be an arbitrary fixed element of vjf^ and set gi{y*) '■= 0. For any 
z G Vp consider an arbitrary oriented path (z±, . . . , z n ) going from y* to z in 
(V^,£7 M ) and define 

fj,(zi)r(zi,z i+1 ) 

If we prove that gg is well defined, i.e. that the above definition (|2.10[) does not 
depend on the chosen path, then it is immediate to check (|2.9|) . 

To show that the definition is well posed, fix an oriented path (u±, . . . , Uf~) from 
z to y* in (V^, E^) (it exists since y* <~ z). Then C = (zi, . . . , z n , 112, ■ ■ ■ , Uk) is a 
cycle going through y* , z. It is trivial to check that all points in C are ^-equivalent 
to y*,z, hence C is a cycle in (V^\ E^). Applying (|2.8[) we get 

Y i og = _y lQg Q*(u^u J+1 ) 

j~[ ^{z l )r(z l ,z l+1 ) ^-J ^(u^riu^Uj+t) 
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This shows that the l.h.s. does not depend on the particular oriented path (zi, . . . , z n ) 
from y* to z, since the r.h.s. is path-independent. Hence gi is well dchncd. 

The function gi does not necessarily belong to L°°(V^), nevertheless we can 
improve a result similar to 

Claim 2.2. The series V, 
and moreover 



? W Q*{Ui z )(9i( z ) ~ 9i(y)) * 5 absolutely convergent 

(2.12) 



Since the series is absolutely convergent the l.h.s. of (|2.12p does not depend on 
the order of summation and therefore is well defined. 



Proof of the claim. By the triangle inequality we have 

q\log(q/p)\<®(q,p) + \q-p\, q,p>0- 
Using the inequality (|2.13|) we have 

< e lo s- 

d/,2)eE(Q«)CE„ 



(2.13) 



fj,(y)r{y,z) 

< I(v,Q*) + \\Q* -Q^Wi <+oo. (2.14) 

Above we have used (|2.5|) and the fact that Q M G L\{E) since (/x,r) < +oo. This 
proves that the series in the l.h.s. of (|2.12[) is absolutely convergent. Trivially, using 
the cyclic decomposition Q* = X^cec Q(^)^-Cj this is equivalent to the bound 

E E Q(C)\gi(z)-gt(y)\<+oo. (2.15) 

' " C is inside (^''.B' 1 ) 

Due to (|2.15|) and the properties of absolutely convergent series (in particular, their 
invariance under permutation of the addenda) we get 



E 



CeC: 

C is inside (V^ ,E le) ) 



E Q(C)(g e (z) - 9i (y)) 

(y.z)eC 



E 



E 



Q(C)(g e (z) - g e (y)) . (2.16) 



C is inside (V {e ' ,E W ) 



On the other hand, the l.h.s. of (|2.16[) is trivially zero since each sum inside the 
brackets is zero. The r.h.s. of (|2.16l) is simply the l.h.s. of (|2.12[) (recall Lemma 
12. ip . thus concluding the proof of our claim. □ 



Using ([21?]) and (f2~T2"]) we obtain 
E $(Q*(y,z),ix(y)r(y,z))= E KvMy, z) (l - e v ^' 



(2.17) 



Recall that £ is the index set of the equivalence classes for ~ in (V^,£" M ). We 
then consider the oriented graph (£, £) where the oriented edges are given by the 
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pairs {£, £') for which there exists an edge {y, z) G such that y G and 

z E Then the graph {C,£) is an oriented acyclic graph, i.e. it contains no 

cycles. 

We can now conclude the proof. First we consider the case when \C\ < +00. 
Then by Proposition 1.4.3 in [4] the finite acyclic oriented graph (£,£) admits an 
acyclic ordering of the vertices. This means that there exists a bijection h : C — > C 
such that h{£) < h{£') for any {1,1') G £. Then we define h{£) := \C\ -h{£) + 1 to 
get a bijection h : C — > C such that h{£) > h{l') for any {£,£') E £. 

Consider the sequence of functions jW E L°°{V) ,n E N defined by 

g {n)f y \ . = \9t\v) + h W n if V G ^ W for some I E C , . 
I otherwise , 



where 

(n), s j^(y) if < f 

We finally get 



k \ai\v)\ 3 



Jx(ji)> Hm -{fi,e- gW L^ ln) ) 



lim V p(y)r(i/,j?)(i-e v » 



lir ? E E v(y) r (vi z ) f 1 

+ E E ^(»)r(»,«)(l-e»i" ) ^-»i B5 W + t h ^- h ^ n )].(2.20) 

fc^' (y,z)€E,: 

The above limit can be computed applying the Dominated Convergence Theorem. 
To this aim we first observe that 

'\Vg ( f ) {y,z)\ < \Vgt{y,z)\ ]£(y,z)eEjf> 
< sign{Vgf\y,z)} = sign{Vg e {y, z)} if (y,z) E E%> 

J^{y)-gt\z) + W)-h{l)]n < -in if {y,z) G E» , y G , z G Vp . 

(2.21) 

Note that in the second case we have used that {£, £') G £ thus implying that 
h{£') — h{£) < — 1. Note moreover that due to (|2.21[) we can write 

J 1 _ e V 9 <"' (V,.)| < 1 + e V 9 , (y ,*) ) (y tZ )eEjf>. 

Since (/i,r) < +00 and due to (|2.9p we are allowed to apply the the Dominated 
Convergence Theorem. As a consequence, we get 

Jl(/i) > r.h.s. of (g^D| 



E E MyM^)(i-e v ^))+ 2 MvM»,*) 

I{fx,Q*)=h{fx). 



(2.22) 
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Note that the second equality is a byproduct of (|2.6j) and f)2 . 1 Tj) . This ends the 
proof of = Ji{fi) when \C\ < +00. A special case with \C\ < +00 is when 

supp(/x) = V. In this case \C\ = 1 since = E and the Markov chain £ is 
irreducible. 

We can now treat the general case. Let /x be an arbitrary probability measure 
on V. We want to show that Ji(fi) > 

We hrst observe that Ji{tt) = 0, where we recall that it is the unique invariant 
measure of the Markov chain £. Indeed, since 1 — e x < x for all x £ R, we have for 
<my geL°°(V) 

K(y)r(y,z)(l-e v ^)< n(y)r(y,z)Vg(y,z) = 0. (2.23) 

The last equality in (|2.23p follows by (|2.3I) since Q 71 is a divergence-free element of 
L+(E). Equation (|2.23[) gives Ji(tt) < and the converse inequality is obtained 
selecting in (|2.2[) a constant function g. This concludes the proof that Ji{~k) = 0. 

Since supp(7r) = V for any c £ (0, 1) supp(c/i + (1 — c)tt) = V so that from the 
result obtained in the case \C\ < +00 we know that 

Ji(c/x + (1 - c)tt) = h{cn + (1 - c)tt) . (2.24) 

Since Ji is defined as a supremum of convex functions it is a convex function, hence 
Ji(cfi + (1 - c)7r) < cJi()Lt) + (1 - c) Ji(7r) = cJx(/i). Invoking ((2TM1) we get 

, , (c/i + (1 — c)7r) . , , 

Ji (u) > lim inf V - V ^ >h{p)- 2.25 

c->l c 

In the last inequality we have used the lower semicontinuity of I\. 



3. Proof of Proposition 11.71 

We will use both the equivalent representations (|1.12[) and (|1.13l) of the rate 
function X. We take [i £ "P(V) with (fi, r) < +00 and recall equation (| 1 . 16[) that 
defines the extended function g : V — > [—00, +00) as g(y) := log *J fj,(y)/ir(y), 
with the convention logO := —00. We consider also the sequence of functions 
g {n) g L oo(y^ defined by 

(n) , , j g(y) if \g(y)\ < n, 

where by (— oo)/(+oo) we mean —1. We observe that (use 2ab < a 2 + 6 2 ) 

X] ^2 viy^iy, z)e Vg{y - z) = X X \/f 1 (y) r (y^ z )^( z ) r ( z 'y) ^ (m> r ) < +°°- 

The above bound and the inequality |1 — e V9 " ^'^j < 1 + e Vg ( y,z \ allows to 
apply the Dominated Convergence Theorem. As a consequence, by an elementary 
computation we get 

lim -(f,,e-^Le gM }= £ (V^FE *) - VM^M*, v)Y , (3-1) 

{j/,*}eE* 

where with we denote the set of unordered bonds. Since we are considering the 
reversible case then necessarily if (y,z) £ E then also (z,y) £ E. Consequently 
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{y, z} G E u when both (y, z) and (z,y) belong to E. Equation p.lj) implies that 
is greater or equal to the right hand side of (|3.1|) . 
To prove the converse inequality we restrict the infimum in (|1.12|) to symmetric 
flows, i.e. to flows Q such that Q(y, z) = Q(z, y) for any (y, z) G E. Then we can 
define S : E u — > M + by S({y, z}) :~ Q(y,z) = Q(z,y). For symmetric flows the 
rate function Q) can be written as 



£ [2S({y,*})log- 



S({y,z}) 



{ y^ z}< ,E^ ~ v //i(y)r(y,z)^(z)r(z,y) , 3 ^ 

v(y) r (y, z ) + K z ) r ( z , v) - 2S ({y, z )) 



The minimization procedure in (|3.2[) is easy since the zero divergence constraint is 
always satisfied. We can then solve an independent variational problem for each 
unordered bond, without any constraint apart the non-negativity of S. On the 
bond {y, z} the minimizer is 



S*({y,z}) = y/n(y)r(y,z)n(z)r(z,y) . 

Calling Q* the associated symmetric flow we get that I(fi,Q*) coincides with the 
right hand side of (|3.1[) . This completes the proof. 



4. Alternative proof of Theorem 11.61 for V finite 

As explained after Theorem ll.6l we only need to show the identity I\ — J\ (recall 
(I2~TD and flggP ). 

In the finite case an interesting proof of this result is obtained observing that it 
is a special case of the Fenchcl-Rockafcllar Theorem (see for example [3]). In the 
case |V| = +00 this strategy does not work since the continuity requirement in the 
following general statement is missing. Consider a topological vector space X and 
its dual X*. Let <j>, tp : X — > (—00, +00] be two proper (i.e. not identically equal 
to +00) extended convex functions such that <fi + ip is proper and there exists an 
xq G X where either 4>(xo) < +00 and <p is continuous at xq or ip( x o) < +°o and ip 
is continuous at xq. The Fenchel-Rockafellar Theorem states that 

mi Mx)+1>(x)} = sup {-^(-f)-r(f)} , (4.1) 

where, given 7 : X —> ( — 00, +00], 

7*(/)~ sup {</,*> - 7 (a0) , / G X* , 

is the Legendre transform of 7. 

Fix /1 G V(V) and recall the definition of the graph (V^, E^) given at the begin- 
ning of Section [2l as well as the equivalence relation ~ leading to the equivalence 
classes V/2 , £ G C, and associated set of edges E^ . Since V is finite the condition 
(yU, r) < +00 is automatically satisfied 

We want to apply the Fenchel-Rockafellar Theorem with X = L 1 (£' M ) endowed 
of the standard L 1 -norm and X* = L°°(E^). Clearly in the finite case we could 
work with the simpler choice X = X* = M. Efi with the Euclidean topology (we use 
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if div Q = , 
+oo otherwise . 



instead a more general notation having in mind some possible extensions to the 
infinite case). Our choice for the functions <j>, ip is 

( E ®{Q{y,z),Q»(y,z)) i{QeL\(E„), 
I +oo otherwise. 

i>{Q) ■-- 

Given Q G L 1 (£' M ) the divergence divQ : V —> R is still defined as 

divQ( y )= Q(y> z )- E Q&v)- 

The above functions <f>, ip are proper convex functions (recall that $(-,p) is convex 
for any p > 0). Moreover, since 3>(-,p) is a continuous function on (0, -foo) for all 
p > 0, we conclude that 4>(Q) < +°° an d 4> is continuous at Q for any Q € X 1 (£' At ) 
such that Q(y, z) > for all (y, z) G E^, Finally, we note that the function <f> + ip 
is proper since finite on the zero flow. Note that working with E instead of E^, 
neither ip nor (j> would have satisfied the condition of boundedness and continuity 
in at least one point. 

Clearly it holds 

h(fi)= inf Q)= jnf {4>{Q) + ip{Q)} ■ (4.2) 

QeL\(E) QeLi(B M ) 

The fact that 1\ (//) = J\ (/i) then follows as a byproduct of the Fenchel-Rockafellar 
Theorem and the following Claims 14.11 and 14.31 

Claim 4.1. For any f G L° a (E fJi ) we have 

W) = E MvMv, *) - 1) , / e ■ (4.3) 

Proof. For each edge (y, z) G E^, the function R + 3 u —> f(y, z)u — $(m, Q^{y, z)) 
has maximum value n(y)r(y, z) (e^ y ' z ^ — l) attained at it = e^ v ' z 'Q fJ '(y, z) = 
e fMiM(y)r(y,z). □ 



Before stating Claim 14731 we prove a geometric characterization of gradient func- 
tions on oriented graphs. To this aim we fix some language. 

We define E^ as the set of oriented edges (y, z) such that (y, z) G E^ or (z, y) G 
Ep. Given a function / on E^ we can extend it to a function /* on E* setting 



f*(y,z) 



f(y, z ) if (y, z) G Efj, , 
K -f(z,y) if (y,z)GE;\E fl . 

We say that (xi,X2, ■ ■ • , x„) is a generalized path from x\ to x n in (V^,^) if for 
any i=l,...,ra-lit holds (x,, x^+i) G -E* (in other words, (xi ) is an 

oriented path in (V^, E*)), Given a generalized path 7 we define J f as 



n-l 

/ := E /*( aj i> a: *+i) 
i=l 



if 7 is given by Xi, X2, . 
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Lemma 4.2. Given f £ L 00 (E fl ) there exists a g : V — > M. such that f = Vg, i.e. 
such that f(y,z) = g(z) — g(y) for all (y,z) £ E^, if and only if for any pair of 
generalized paths 7 and 7' having the same initial point and the same final point it 
holds 

' f = I /• (4-4) 

7 J i 1 

Proof. If is simple to check that if / = Vg then /*(y, z) = g(z) — g(y). This implies 
that J f = g(z) —g(y) for any generalized path 7 in (V^, E^) from y to z. Therefore 
(|4.4|) is satisfied whenever 7, 7' have the same extremes. 

Suppose on the other hand that (|4.4j) is satisfied for any 7, 7' having the same 
extremes. We introduce on the equivalent relation ^* saying that y ~* z if 
there exists a generalized path from y to z in (V^,.E M ). It is simple to check that 
we have indeed an equivalence relation. For each equivalence class W C we fix 
a reference site a;* 6 W and define g on W setting g(y) := J / where 7 is any 
generalized path from to y. Due to (|4.4j) the definition is well posed. Let us 
check that Vg = f. To this aim we fix (y, z) £ E^. Clearly this implies y z. 
Call x* the reference site of their equivalence class and fix a path 7 from x* to y. 
If 7 = (xi,X2, ■ ■ ■ ,x n ) set 7 := {x\,X2, ■ ■ ■ ,x n ,z). The path 7 is a generalized path 
from x* to z. By definition g(z) = f~f = f(y,z) + J 7 / = f(y,z) + g(y), thus 
concluding the proof. □ 

We can now state our final claim: 
Claim 4.3. For any f £ ^(E^) we have 

|0 if f = Vo for some g : V ->• R , ,„ 
4'*(.f) = { , ' . (4.5) 

I +00 otherwise . 

Proof. By a simple integration by parts it is trivial to check that it holds (/, Q) = 
if / e L co (E I j j ) is of gradient type (i.e / = Vg) and Q £ L 1 (S At ) is a divergence-free 
flow (see (|2.3p ). As a consequence we get 

r(f)= sup {(/ ! o)-v(Q)} = o ! 

for any / of gradient type. 

Conversely suppose that / is not of gradient type. Then, by Lemma 14.21 there 
exist two generalized paths (xi, X2, ■ ■ ■ , x n ) and (y\, y2, ■ ■ ■ , y m ) hi (V^,-E^) such 
that xi = yi, x n = y m and 

n— 1 m—1 

^2f*(xi,x i+ i) - f*(yj>Vo+i) > °- (4-6) 
i=l j=l 

The given A > we define the divergence-free Q\ £ L 1 (£' Al ) as 

A i£(y,z) = (xi,x i+ i)i = l,...,n-l, 

-A if (y, z) = (x i+ i,Xi) and (xi,x i+ i) £ E^ i = 1, . . . , n - 1 

v(2/> z ) : = S -A if (y,z) = {yj,y J+1 ) j = 1,. ..,m- 1, 

A if {y,z) = {Vj+uVj) and {yj,Vj+i) & j = I,. ..,m - 1 , 

otherwise . 
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Then (/, Q\) equals A times the r.h.s. of (|4.6|) . thus implying that limA-^+oo (/, Q\) = 
+00. In particular, we obtain 

r(f)> ((/,Qa>-V(Qa)) = +oo. 

A— f+oo 

This ends the proof of our claim. □ 
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